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ABSTRACT 

A quantum algorithm for an oracle problem can be understood as a quantum strategy for 
a player in a two-player zero-sum game in which the other player is constrained to play 
classically. I formalize this correspondence and give examples of games (and hence oracle 
problems) for which the quantum player can do better than would be possible classically. 
The most remarkable example is the Bernstein- Vazirani quantum search algorithm which 
I show creates no entanglement at any timestep. 
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1. Introduction 

Despite the exuberance of people working on quantum computation — and more generally, 
quantum information theory — we discuss remarkably few quantum algorithms. These in- 
clude, and are largely limited to, the Deutsch-Jozsa [1], Simon [2], Shor [3] and Grover 
[4] algorithms. Of course, quantum versions of many other information processing tasks 
have also been studied: cryptography [5] , error correction [6] , communication channels [7] , 
distributed computation [8] , etc. When I was invited to speak about quantum computing 
at Microsoft Research in January 1998, I decided to try to add game theory to this list. 

My motivations were twofold: First, as I explained in that talk, von Neumann was 
not only the driving force behind the development of modern digital computers [9] — a 
subject of great interest to Microsoft — but also one of the founders of quantum mechan- 
ics [10], and thus someone whose ideas are central to quantum computing. But he had 
another great interest — shared with Microsoft — economics! Von Neumann essentially in- 
vented game theory [11]; his book with Morgenstern, Theory of Games and Economic 
Behavior [12] raises (and in some cases, answers) many of the questions which preoccupy 
game theorists and economists today. Second, I hoped that something like the argument 
that identifies which two-person zero-sum games have optimal mixed, rather than pure, 
classical strategies might provide some insight into which problems are solvable more ef- 
ficiently by quantum rather than classical algorithms. This hope was probably somewhat 
naive, but it brings us to the first question I'll address in this talk: What do quantum 
games have to do with quantum algorithms? 

The quantum game I described originally [13], PQ PENNY FLIP, is perhaps too simple 
to make the connection with quantum algorithms completely clear. In fact, it is so simple, 
involving only one qubit, that several people have pointed out that it could be simulated 
classically [14] . I have argued elsewhere that this misses the point slightly, that the issue is 
not whether there exists a classical simulation, but how the complexity of that simulation 
would scale if the size of the game were to increase [15]. To illustrate this point explicitly, 
in this talk I'll tell a story which involves a game which has instances of arbitrarily large 
size. My discussion of this game naturally includes a description of Grover's algorithm [4] , 
which not only helps to answer the first question, but raises a second and third. 

The second is: Are there sophisticated quantum search algorithms? More explicitly, 
are there 'databases' which can be 'searched' with better than the square root speedup that 
Grover's algorithm provides over the best possible classical algorithm? [4] Since Bennett, 
Bernstein, Brassard & Vazirani [16], Boyer, Brassard, H0yer and Tapp [17], and Zalka [18] 
have shown that Grover's algorithm is optimal, I will explain the natural changes in the 
problem which make this question interesting. 

Recently Lloyd has argued that Grover's algorithm can be implemented without en- 
tanglement [19]. At first glance this may appear surprising: many people have stated 
that the power of quantum computing derives from entanglement [20,21]. This belief un- 
derlies the criticism that NMR experiments do not realize quantum computation because 
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the state of the system at each timestep is separable [22], i.e., a convex combination of 
unentangled pure states [23]. Similarly, van Enk observed that the one qiibit PQ PENNY 
Flip game not only can be simulated classically, but involves no entanglement [14], which 
would suggest by the same 'reasoning' that such a quantum game would be unrelated to 
quantum algorithms. In fact, the quantum game in the story to come provides an answer 
to the third question I'll address: Can quantum-over-classical improvements be achieved 
without entanglement? 



2. PQ games 

I'll begin by reviewing briefly the one qubit game PQ PENNY FLIP [13]. In our first episode, 
the starship Enterprise is facing some imminent catastrophe when the superpowerful being 
Q appears on the bridge and offers to resciie the ship if Captain Picard* can beat him at 
a simple game: Q produces a penny and asks Picard to place it in a small box, head up. 
Then Q, followed by Picard, followed by Q, reaches into the box, without looking at the 
penny, and either flips it over or leaves it as it is. After Q's second turn they open the 
box and Q wins if the penny is head up. Q wins every time they play, using the following 
quantum strategy: 

10) ^ + 

i^x or I2 y 2 

^ |0) 

H 

Here |-) is Dirac notation [25] for an element of Hilbert space, denotes 'head' and 1 
denotes 'tail', H = -^(]^ _\) is the Hadamard transformation, and = (10) implements 
Picard's possible action of flipping the penny over. Q's quantum strategy of putting the 
penny into the equal superposition of 'head' and 'tail' on his flrst turn means that whether 
Picard flips the penny over or not, it remains in an equal superposition which Q can rotate 
back to 'head' by applying H again since H = H~^. So when they open the box, Q always 
wins. 

Notice that if Q were restricted to playing classically, i.e., to implementing only cr^ 

or I2 on his turns, an optimal strategy for both players would be to flip the penny over or 
not with equal probability on each turn. In this case Q would win only half the time, so 
he does substantially better by playing quantum mechanically. 

The structure of PQ PENNY FLIP motivates the following deflnition which formalizes 
one meaning for quantum game.^ 



Captain Picard and Q are characters in the popular American television (and movie) series Star 1>eJc: 
The Next Generation whose initials and abilities are ideal for this illustration. See [24]. 

Eisert, Wilkens & Lewenstein have proposed a different formalism for quantum games and have 
applied it to find a (unique) Pareto optimal equilibrium for the Prisoners' Dilemma when the players 
are allowed to select moves from the same specific subset of unitary transformations [26]. Benjamin 
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Definitions. A PQ game consists of 

{i) a Hilbert space 7i — the possible states of the game — with N — dimH, 
(ii) an initial state 1(^0 e H, 

(m) subsets Qi C U{N), i G {!,..., /c + 1} — the elements of Qi are the moves Q 
chooses among on turn i, 

(iv) subsets Pi G Sn, i ^ {l?---?^}? where S'at is the permutation group on N 
elements — the elements of are the moves Picard chooses among on turn i, and 

(v) a projection operator 11 on H — the subspace Wq fixed by 11 consists of the winning 
states for Q. 

Since only Picard and Q play, these are two-player games; they are zero-sum since 
when Q wins, Picard loses, and vice versa. 

A pure quantum strategy for Q is a sequence Ui G Qi. A pure {classical) strategy for 
Picard is a sequence Si e Pi, while a mixed (classical) strategy for Picard is a sequence 
of probability distributions fi'.Pi^ [0, 1]. If both Q and Picard play pure strategies, the 
corresponding evolution of the PQ game is described by 

V'/ = Uk+lSkUk . . . U2SiUli>Q. 

After Q's last move the state of the game is measured with 11. According to the rules of 
quantum mechanics [10], the players observe the eigenvalue 1 with probability Ti^ip'^Ihl))] 
this is the probability that the state is projected into Wq and Q wins. More generally, if 
Picard plays a mixed strategy, the corresponding evolution of the PQ game is described 

by 

where Po ~ V'o ® ''Ao- Again, after Q's last move p/ is measured with H; the probability 
that p/ is projected into Wq ® Wq) and Q wins is Tr(npj). 

Finally, an equilibrium is a pair of strategies, one for Picard and one for Q, such that 
neither player can improve his probability of winning by changing his strategy while the 
other does not. 

As I'll show in the next section, the structure of a PQ game specializes to the structure 
of the known quantum algorithms. In general, unlike the simple case of PQ PENNY FLIP, 



& Hayden recently showed that this is not a solution when the players are allowed to make arbitrary 

unitary moves [27]; in fact, in this case there is no equilibrium, just as in PQ Penny Flip [13]. 
Nevertheless, that formalism still seems likely to be interesting, although more closely related to 
quantum communication protocols [8,28] than to quantum algorithms. 
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Wq = Wqdsj}) or Wq = WQ{{fi}), i.e., the conditions for Q's win can depend on 

Picard's strategy. Each of the three example games I consider here suffices to prove that 
there are games with mixed/quantum equilibria at which Q docs better than he would 
at any mixed/mixed equilibrium; equivalently, there are some quantum algorithms which 
outperform classical ones. 

3. Guessing a number 

In our second episode, Q returns to the Enterprise and challenges Captain Picard again. 
He boasts that if Picard picks any number between and AT — 1, inclusive, he can guess it. 
Now, Picard is no slouch; he has been studying up on quantum algorithms since the last 
episode. In particular, he has studied Grover's algorithm [4] and realizes that for A?" = 2", Q 
can determine the number he picks with high probability by playing the following strategy: 

Q 1 1 



|o...o,o) M 

1 1 

-=5](-l)^^«|a;)®-=(|0)-|l)) (.0 

V — o V 



Picard 

S{fa) 

Q, 



where a G [0, — 1] is Picard's chosen number, and the moves si and U2 are repeated a 
total of k = [^VN\ times, i.e., Sk — ■ ■ ■ = si and Uk+i = ■ ■ ■ = U2. For f : —>■ Z2, s{f) 
is the permutation (and hence unitary transformation) defined by 

s{f)\x,b) = \x,b®f{x)), 

where © denotes addition mod 2. This transformation is often referred to as '/-controUed- 
NOT'. Each of Picard's moves Si can be thought of as the response of an oracle which 
computes fa{x) := Sxa to respond to the quantum query defined by the state after Ui. 
After 0{VN) such queries, a measurement by 11 = \a){a\ ® I2 returns a win for Q with 
probability bounded above |, i.e., Grover's quantum algorithm determines a with high 
probability. (Here (a| := \a)^ and the tensor product is implicit in \a){a\ [25].) 

Notice that if Q were to play classically, he could query Picard about a specific number 
at each turn, but on the average it would take N/ 2 turns to guess a. A classical equilibrium 
is for Picard to choose a uniformly at random, and for Q to choose a permutation of N 
uniformly at random and guess numbers in the corresponding order. Even when Picard 
plays such a mixed strategy, Q's quantum strategy is optimal; together they define a 
mixed/quantum equilibrium. 

Knowing all this, Picard responds that he will be happy to play, but that Q should 
only get 1 guess, not [f •\/iVj. Q protests that this is hardly fair, but he will play, as long 
as Picard tells him how close his guess is to the chosen number. Picard agrees, and they 
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play. Q wins. They play again. Q wins again. Picard doesn't understand what's going on. 
The problem is that in his studies of quantum algorithms, he overlooked an insufficiently 
appreciated quantum algorithm, the slightly improved [29] Bernstein- Vazirani algorithm 
[30]: Guess x and answer a are vectors in Z2, so x ■ a depends on the cosine of the angle 
between the vectors. Thus it seems reasonable to define "how close a guess is to the 
answer" to be the oracle response ga{x) := x ■ a. Then Q plays as follows: 

1 ^"^ 1 

|o...o,o) ^ ^El^)®^(|o)-|i)) M 



Picard 
s{9a) 



x=0 

1 ^\ , 1 



-= j](-ir«ix)^-=(io)-|i)) (.1) 

x=0 
1 



^ 'a)®4^(|o)-|i)) M 



For n = |a)(a| /2 again, Q wins with probability 1, having queried Picard only once! 

Just as before, Picard makes the game hardest for Q classically if he chooses a uni- 
formly at random. Classically Q requires n queries to determine a with probability 1. 
The classical to quantum improvement in number of queries is thus n to 1, in some sense 
greater than the Grover improvement from 0(N) to 0(\/N). 



4. Entanglement 

Most remarkably, Bernstein & Vazirani's 'sophisticated' quantum search algorithm achieves 
this improvement without creating any entanglement at any timestep! Recall the following 
definition. 



Definition. A pure state — a vector in H — is entangled if it does not factor relative to a 
given tensor product decomposition of the Hilbert space [31]. 

In the two algorithms considered in the previous sections, the Hilbert space decom- 
poses into a tensor product of qubits [32], i.e., C^s. To see that the slightly improved [29] 
Bernstein- Vazirani algorithm [30] creates no entanglement relative to this decomposition, 
note that ■i/'o has no entanglement, and hence 'Ui'i/'o has none since ui is the tensor product 
of operations on individual qubits. Also, '(/'/is not entangled since |a) is just the tensor 
product of qubits in states |0) or But ipf is obtained from the intermediate state 
siuiif^o by the action of U2 which, like ui, is the tensor product of operations on individual 
qubits. So siUiif^o also is not entangled. 

In contrast, for Grover's algorithm, every state after uii/jq is entangled for n > 1. 
By a natural measure the entanglement oscillates with period f -s/iV, i.e., after [f -\/iVj 
queries the state is close to \a) :^(|0) ~ ^^nd its entanglement is fairly small, while 

after only [f-\/iVj queries the entanglement is fairly large [33]. So what could be the 
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suggestion of Lloyd, to which I alluded in the Introduction, that Grover's algorithm can be 
implemented without entanglement [19]? He simply observes that since the first n qubits 
are never entangled with the last qubit, if they are implemented by a single tensor factor 
of dimension N, there is no entanglement. This is true, of course, by definition, and has 
been observed earlier in the general quantum computing setting by Jozsa and Ekert [20]. 
The cost incurred for realizing such a scheme physically, as Lloyd acknowledges, increases 
exponentially with n and must be paid with increasing energy, mass, or precision. 

5. Conclusion 

So what do quantum games have to do with quantum algorithms? The two versions of 
Guess a Number illustrate the relation for oracle problems. In these cases, quantum 
algorithms specialize the PQ game definition to reqviire that si = ■ ■ ■ = Sk, i.e., the oracle 
always responds the same way once a function has been chosen. Furthermore, the winning 
states for Q, Wq, depend on Picard's strategy {sj}, i.e., on a. The Deutsch-Jozsa [1], 
Simon [2] and Shor [3] algorithms can also be described this way. 

Are there 'sophisticated' quantum algorithms? Yes. The oracle which responds in the 
Bernstein- Vazirani scenario with x ■ a mod 2 is a 'sophisticated database' by comparison 
with Grover's 'naive database' which only responds that a guess is correct or incorrect. 
The former is closely related to the vector space model for information retrieval in which 
there is a vector space with basis vectors corresponding to the occurrence of key words: 
database elements define vectors in this space and are ranking according to their inner 
product with the vector representing a query [34]. Furthermore, relatively speaking, it 
improves more over the classical optimum than does Grover's algorithm. 

And finally, is entanglement required for quantum-over-classical improvements? No. 
I've shown that, remarkably, the slightly improved version of the Bernstein- Vazirani algo- 
rithm does not create entanglement at any timestep, but still solves this oracle problem 
with fewer queries than is possible classically. Relative to the oracle, this quantum al- 
gorithm has no entanglement, unlike Grover's, which does — at least within the standard 
model of quantum computing. It illustrates both 'sophisticated quantum search' without 
entanglement and sophisticated "quantum search without entanglement" [35]. 
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